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REMOTE CONTROL SYSTEM 

BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a remote control 
system for remotely controlling network devices on a 
network . 

Related Background Art 

In the past, it has been greatly requested that 
household audio visual (AV) equipments and/or 
electrical equipments which are operated solely or 
operated in connection with another equipment be 
interconnected by a single network. Such request has 
been satisfied by a high speed digital communication 
technique capable of transferring data such as moving 
image data and voice data which require real time 
ability and data such as still image data and control 
data which require reliability of transfer in a mixed 
condition. 

As one method for controlling peripheral 
equipments interconnected by the network by means of a 
host equipment, in a household network, a technique in 
which the host equipment is constituted by a television 
which provides a user interface and a control panel for 
operating the peripheral equipment is displayed on a 
screen of the television and the operator can effect 
setting in the control panel by using a remote 



controller of "the television so that the peripheral 
equipments are controlled by the television itself on 
the basis of such setting is considered. 

However, in the above-mentioned method, it is 
required that the control panel to be displayed and 
command /program for effecting the control on the basis 
of the user's setting be previously prepared in the 
television. Since such command and program must be 
prepared for each peripheral equipment and many 
peripheral equipments are connected to the network, the 
numbers of the control panels, commands and programs 
are increased considerably. Further, since it is 
naturally guessed that new equipments are added to the 
network in the future, if control panels, commands and 
programs for all of equipments which are to be 
additionally connected to the network are prepared in 
the television, the number of the control panels, 
commands and programs will be further increased. 
Furthermore, it is impossible to prepare control 
panels, commands and programs for the future 
equipments . 

In order to solve the above problems, for example, 
Japanese Patent Application Laid-open No. 11-3314 
proposes a system in which control panels are sent from 
controlled devices connected to a network and a control 
device such as a television having a display device 
receives such control panels to display the control 



panels for the operator so that the operator can send 
his operation inputs to the controlled devices to 
control the latter. 

Fig. 14 is a block diagram showing a construction 
of such a conventional remote control system. 

In Fig. 14, the system includes a network 300, a 
controlled device 310 and a control device 320. The 
controlled device 310 sends a control panel of the 
controlled device 310 to the control device 320. The 
control device 320 displays the control panel of the 
controlled device 310 on a display device 324. The 
operator manipulates or handles the control panel 
displayed on the display device of the control device 
320 to remotely control functions of the controlled 
device 310. 

However, the conventional remote control system 
arises a problem that, if the functions of the 
controlled device 310 are highly progressed, the number 
of operation buttons, switches and the like is also 
increased accordingly. Thus, the operator manipulating 
the control device 320 is compelled to complicated 
operation. Namely, for the operator, there arises a 
problem that, although he can control higher functions 
remotely, he is compelled to the complicated operation. 
Now, this is explained concretely. 

For example, when it is assumed that the control 
device 320 is constituted by a television and the 
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controlled device 320 is constituted by a digital 
photo-album device capable of effecting accumulation, 
display and edition of a digital image, a case where a 
control panel of the digital photo-album device is 
5 displayed on the television will be explained. 

Fig. 15 is a view showing the control panel of the 
digital photo-album device displayed on the television 
in the conventional remote control system. 

In Fig. 15, the reference numeral 350 denotes 
10 thumbnail-displayed digital photo images A to P which 
are elements to be selected. The reference numerals 

w 

f" 351 to 354 denote process elements to be executed for 

Ui 

■ M one element selected among the digital photo images A 

5 to P, where the reference numeral 351 denotes display 

N* 

W 15 process; 352 denotes right turn process; 353 denotes 

111 left turn process; and 354 denotes deletion process. 

y, For example, in Fig. 15, since the process element 

"display" 351 is selected by reversely rotating (black 
spot displaying) a check box and a cursor is focused on 
20 the digital photo image G, when the operator depresses 
an execution key of a remote controller in this 
condition, the digital photo image G is displayed in a 
larger scale. 

Fig. 16 is a view showing television screen on 
25 which the digital photo image G is displayed in the 
greater scale. 

In Fig. 16, since the cursor is focused on a 
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process element "return" 361, when the operator 
depresses the execution key of the remote controller in 
this condition, the control panel displayed on the 
television is returned to the display of Fig. 15. 
5 Here, for example, it is assumed that the digital 

photo image C among the thumbnail-displayed digital 
photo images 350 is displayed in a lateral posture. 
For example, this corresponds to a photograph obtained 
by photo-taking an image by means a digital camera 

10 positioned in a vertical posture. 

In this case, as the operator's manipulation, 
first of all, a cursor shifting key unit of the remote 
controller including an up shift key, a down shift key, 
a left shift key and a right shift key is appropriately 

15 manipulated to focus the cursor on the process element 
"left turn" 353, and then, the execution key is 
depressed in this condition. As a result, the check 
box for the process element "display" 351 is not 
selected and the check box for the process element 

20 "left turn" 353 is selected. Fig. 17 is a view showing 
the control panel of the digital photo-album device in 
the condition that the check box for the process 
element "left turn" 353 is selected. 

Further, the cursor shifting key unit is 

25 appropriately manipulated to focus the cursor on the 
digital photo image C, and then, the execution key is 
depressed in this condition. As a result, the digital 



photo image C is turned by 90 degrees in an anti- 
clockwise direction and is displayed. 

Next, a case where the operator tries to delete 
the digital photo image J among the thumbnail-displayed 
digital photo images 350 will be explained. 

The operator appropriately manipulates the cursor 
shifting key unit to focus the cursor on the process 
element "deletion" 354, and then, the execution key is 
depressed in this condition. As a result, the check 
box for the process element "deletion" 354 is selected 
and the check boxes for the process elements 351 to 353 
are not selected. Further, the cursor shifting key 
unit is appropriately manipulated to focus the cursor 
on the digital photo image J, and then, the execution 
key is depressed in this condition. Fig. 18 is a view 
showing the control panel of the digital photo-album 
device in the condition that the check box for the 
process element "deletion" 354 is selected. 

As a result, the digital photo image J is deleted. 

As mentioned above, although the operator can 
utilize the higher function remotely, he is compelled 
to the complicated manipulation. Further, in the data 
transfer effected between the control device and the 
controlled device, since the amount of data to be 
transferred is increased, there arises a problem that 
the transferring time is increased. 



SUMMARY OF THE INVENTION 

An object of the present invention is to solve the 
above-described problems . 

Further, the present invention is made in 
consideration of the above-described problems, and 
another object of the present invention is to achieve 
excellent operability at a control device side and to 
reduce a transferring data amount between a control 
device and a controlled device. 

A preferred embodiment of the present invention 
provides a control device for remotely controlling a 
controlled device connected to a network, comprising 
display means for displaying a control panel of the 
controlled device, and sending means for sending 
operation information representing a shifting history 
of a cursor displayed on the control panel to the 
controlled device. 

Another preferred embodiment of the present 
invention provides a controlled device controlled 
remotely by a control device connected to a network, 
comprising sending means for sending a control panel of 
the controlled device to the control device, receiving 
means for receiving operation information representing 
a shifting history of a cursor displayed on the control 
panel, and control means for controlling a function 
corresponding to the operation information. 

Still other objects of the present invention, and 



advantages thereof, will become fully apparent from the 
following detailed description of the embodiments. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Fig. 1 is a block diagram for explaining a 
construction of a remote control system according to a 
first embodiment of the present invention; 

Fig. 2 is a view for explaining an operation unit 
of a remote controller 1140 for remotely controlling 
television 1000; 

Fig. 3 is a view for explaining a laminate layer 
structure of an IEEE 1394 serial bus 1250; 

Fig. 4 is a view for explaining an FCP; 

Figs. 5A and 5B are views for explaining a 
structure of asynchronous transfer packet used in an 
FCP layer; 

Fig. 6 is a view showing a control panel of a VCR 

1200; 

Fig. 7 is a view showing button IDs of various 
button elements; 

Fig. 8 is a view showing a list of history 
elements; 

Fig. 9 is a flow chart showing procedure of 
operations based on external operation in the 
television; 

Fig. 10 is a sequence view showing procedure of 
screen display process; 



Fig. 11 is a block diagram for explaining a 
construction of a remote control system according to a 
second embodiment of the present invention; 

Fig. 12 is a view showing a control panel of a 
digital photo-album device 1300 displayed on a 
television 1000; 

Fig. 13 is a view showing the control panel of the 
digital photo-album device 1300 after the control panel 
is renewed; 

Fig. 14 is a block diagram showing a construction 

of a conventional remote control system; 

Fig. 15 is a view showing a control panel of a 

digital photo-album device 1300 displayed on a 

television in the conventional remote control systems- 
Fig. 16 is a view showing a screen of the 

television on which a digital photo image G is 

displayed in a larger scale; 

Fig. 17 is a view showing the control panel of the 

digital photo-album device 1300 in a condition that a 

check box for a process element "left turn" is 

selected; and 

Fig. 18 is a view showing the control panel of the 

digital photo-album device 1300 in a condition that a 

check box for a process element "deletion" is selected. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
( First embodiment; ) 

First of all, a first embodiment of the present 
invention will be explained. 
5 Fig. 1 is a block diagram showing a construction 

of a remote control system according to the first 
embodiment . 

In Fig. 1, the system includes a television image 
receiving machine 1000 functioning as a control device 

£«!« 

10 which can be controlled remotely by a remote controller 
? ;r 1140. Further, the television 1000 receives digital 

television broadcasting. The television includes a 

m 

: s: tuner unit 1010 which receives a signal from an antenna 

U-i 

* 1020 to demodulate received data and to correct an 

N" 

W 15 error and outputs MPEG-2 transport stream data 

M 

fil (referred to as "TS data" hereinafter). Incidentally, 

a 

| s =h the MPEG-2 transport stream data (referred to as "TS 

data" hereinafter) is defined in MPEG-2 system 
standard. The television also includes a demultiplexer 
20 1030 which serves to pick up desired image data Dl and 
voice data D2 from the TS data in which image data and 
voice data for plural channels are time- share- 
multiplexed. Incidentally, the image data Dl is 
compressed and coded in accordance with the MPEG-2 
25 standard. The picked-up image data Dl is sent to a 

video decoder 1040 and is decoded there, and the voice 
data D2 is sent to an audio decoder 1050 and is decoded 



there. The decoded image data is sent to an image 
synthesis unit 1060. The television also includes a 
voice output unit 1070 which is constituted by a D/A 
converter, an amplifier and a speaker and which serves 
to output the voice data decoded by the audio decoder 
1050 as voice. 

The television also includes a digital interface 
unit (referred to as "1394 interface" hereinafter) 1080 
based on IEEE 1394-1995 standard, a display data memory 
1090 for storing data of a control panel received by 
the 1394 interface 1080, and a drawing control unit 
1100 which serves to produce an image of the control 
panel on the basis of the control panel stored in the 
display data memory 1090. The image synthesis unit 
1060 serves to synthesize the image data decoded by the 
video decoder 1040 and the control panel produced by 
the drawing control unit 1100. The television further 
includes a display unit 1110 having a display device 
such as a liquid crystal display device and serving to 
display an image synthesized by the image synthesis 
unit 1060. 

The television also includes a remote controller 
light-receiving unit 1120 which serves to 
receive/decode an infrared ray sent from a remote 
controller 1140 and to output a key code of a key 
manipulated by the operator via the remote controller 
1140. 
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The television further includes a control unit 
1130 having a memory and a microcomputer and serving to 
collectively control the 1394 interface 1080, display 
data memory 1090 and drawing control unit 1100. 
Further, the control unit 1130 also serves to produce 
control information on the basis of the key code 
outputted from the remote controller light-receiving 
unit 1120 and to send the control information from the 
1394 interface 1080 to a controlled device. 

The system includes a digital video cassette 
recorder (referred to as "VCR" hereinafter) 1200 
functioning as the controlled device, a digital 
interface unit (referred to as "1394 interface" 
hereinafter) 1210 based on IEEE 1394-1995 standard and 
having the same construction as the 1394 interface 1080 
of the television 1000, a control panel generation unit 
1220 which serves to store or produce the control panel 
of the VCR 1200 and GUI (graphic user interface) data 
associated therewith, a record/reproduction unit 1230 
which serves to record video data and audio data onto a 
storing medium such as a cassette tape, a magnetic disc 
or hard disc and/or to reproduce the video data and the 
audio data, and a control unit 1240 having a memory and 
a microcomputer. The control unit 1240 serves to 
control sending process for sending the control panel 
of the VCR 1200 from the VCR 1200 to the television 
1000. The controller 1240 further serves to control an 
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operation of the record/reproduction unit 1230 on the 
basis of control information sent from the television 
1000 to the VCR 1200. 

The television 1000 and the VCR 1200 are 
interconnected by a serial bus (referred to as "IEEE 
1394 serial bus" hereinafter) based on the IEEE 1394- 
1995 standard via the 1394 interfaces 1080, 1210. 

Fig. 2 is a view for explaining an operation unit 
of the remote controller 1140 for remotely controlling 
the television 1000. 

As shown in Fig. 2, the remote controller 1140 
includes a key for switching channels, a key for 
setting a voice amount of the television 1000, and a 
key for turning ON/ OFF a power source of the television 
1000. Further, the remote controller includes a 
"panel" key 2000 for reguesting display of the control 
panel, and a "finish" key 2100 for reguesting erasing 
of the control panel. Further, the remote controller 
includes an "up" key 2200, a "down" key 2300, a "left" 
key 2400 and a "right" key 2500 which are used for 
selecting buttons on the control panel . The remote 
controller further includes a "determination" key 2600 
used for executing a function of the selected button. 

Next, a fundamental function of the IEEE 1394 
serial bus 1250 will be explained. 

The IEEE 1394 serial bus 1250 is defined in the 
IEEE 1394-1995 standard and has characteristics such as 
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connection, automatic setting and real time 
transferring which have high degree of freedom. That 
is to say, the IEEE 1394 serial bus 1250 can cope with 
topology of star type as well as topology of daisy 
5 chain type, thereby permitting connection having high 
degree of freedom. Further, the IEEE 1394 serial bus 
1250 is a data transferring system in which serial 
transferring is effected at a transferring speed of 100 
Mbps, 200 Mbps and 400 Mbps, and, since a node 

P| 10 (equipment or device connected) having higher order 

Q 

jjfj transferring speed supports a lower order data 

;t transferring speed, in a system in which various nodes 

y i 
pi i 

: i: are connected via such an IEEE 1394 serial bus 1250, 

m 

nodes having different transferring speeds can exist in 
Hi 15 a mixed condition. The IEEE 1394 serial bus 1250 has 

111 an automatic setting function so that, when a power 

P 

y* source of the node is turned ON/OFF or when a new node 

is connected, such fact is automatically detected to 
effect bus reset. After the bus reset, confirmation of 

20 node and assignment of ID to various nodes are 

automatically effected. Further, in the IEEE 1394 
serial bus 1250, a new node can be connected or any 
node can be disconnected without turning OFF the power 
sources of the nodes connected, and functions for bus 

25 reset, automatically confirmation of topology and 
automatic assignment of ID after disconnection and 
functions for plug and play can be realized. As data 



transferring modes, there are provided two modes, i.e., 
an asynchronous transferring mode suitable for 
transferring control signals such as command and file 
data, and isochronous transferring mode suitable for 
transferring data having time continuity such as moving 
image data and voice data. 

Fig. 3 is a view showing a laminate layer 
structure of the IEEE 1394 serial bus 1250. 

A physical layer 501 serves to define 
mechanical/electrical specification of cable/connector 
and to effect coding/decoding of input/output signals, 
initialization of the bus and mediation of use of bus. 
A link layer 505 serves to provide service for 
realizing communication of packet data between the 
physical layer 501 and a transaction layer 510. The 
transaction layer 510 serves to provide read 
transaction, write transaction and lock transaction 
which are services for realizing asynchronous 
transferring between the link layer 505 and a higher 
order layer such as application. 

In the IEEE 1394 serial bus 1250, there are two 
bus management nodes, i.e., bus manager and isochronous 
resource manager (IRM). They may be the same node. 

A bus management layer 515 serves to perform node 
control, isochronous resource management and bus 
management. The node control has CSRs (control status 
registers) provided in each node of the IEEE 1394 
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serial bus 1250 and defined in IEEE 1212 standard and 
performs management of asynchronous transferring 
between the nodes . The isochronous resource management 
is effected only by a node which is IRM and serves to 
5 afford a channel number and a band to the node to be 

isochronous-transferred and reserve the channel number 
and the ensured band used for the isochronous 
transferring. The bus management is effected only by 
the bus manager node and serves to perform management 
10 of connection information (formation of topology map), 
management of speed information ( formation of speed 
map) and management of power source. 

m 

lit An FCP ( function control protocol ) layer 520 

s serves to perform communication of data having bytes 

H« 

flj 15 smaller than 512 bytes called as command frame and 

N- 

f[| response frame by using the asynchronous transferring, 

Q 

tV thereby permitting control between the nodes. The 

command frame is data written from the control node 
onto a command register of the controlled node. The 

20 response frame is data written from the controlled node 
onto a response register of the control node. Such a 
condition is shown in Fig. 4. Fig. 4 is a view showing 
communication of the command frame and the response 
frame based on FCP between a node A and a node B. 

25 Figs. 5 A and 5B are views showing a structure of 

the asynchronous transferring packet used in the FCP 
layer 520. Command frame data or response frame data 
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is written in a data portion of the packet. 

Returning to Fig. 3, an AV/C command set layer 252 
is an upper side layer for the FCP layer 520 and serves 
to apply connection control of AV/C isochronous 
transferring and control commands for AV eguipments 
such as the television, monitor and VCR to the command 
frame and the response frame. 

Fig. 6 is a view showing an example of the control 
panel of the VCR 1200 shown in Fig. 1. 

In Fig. 6, the control panel includes button 
elements 301 to 306, i.e., a reproduction button 301, a 
stop button 302, a rewind button 303, a fast feed 
button 304, a temporary stop button 305 and a record 
button 306. The reference numeral 307 denote a cursor 
added by the drawing control unit 1100 (Fig. 1); and 
308 denotes a text element representing a present time 
or a tape running count. Here, it is assumed that the 
buttons 301 to 306 have button IDs shown in Fig. 7. 

Further, in the first embodiment, for example, as 
shown in Fig. 8, there is provided a history element 
comprising "contents 1" and "contents 2", which history 
element is transferred together with the control panel. 
Fig. 8 shows a list of history elements, and history ID 
is set in each history element. That is to say, for 
example, the history element having history ID "503" 
has ID "301" of the button element as the contents 1 
and ID "303" of the button element as the contents 2, 
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and the history element having history ID "504" has ID 
"301" of the button element as the contents 1 and ID 
"304" of the button element as the contents 2. 

Next, an operation of the television 1000 based on 
5 external operation will be explained with reference to 
Fig. 9. 

Fig. 9 is a flow chart showing procedure of the 
operation of the television 1000 based on the external 
operation. 

j. - 

10 First of all, the control unit 1130 of the 

n 

|:| television 1000 monitors the key code sent from the 

;'" remote controller light-receiving unit 1120 (step ST 

in 

*H.f 

501) and effects various processes on the basis of the 

s key code. 

N' 

fit 15 Firstly, if the panel key 2000 is depressed, the 

ul screen display process is performed (step ST510). 

a 

y, Fig. 10 is a sequence view showing procedure of 

the screen display process. 

First of all, the control unit 1130 of the 

20 television 1000 performs connection establishment in 

the AV/C asynchronous connection protocol layer 540 in 
accordance with the connection establishing procedure 
in order to transfer the control panel of the VCR 1200 
to the television 1000 (steps ST5402, ST5403 ) . When 

25 the connection is established, the control unit 1130 of 
the television 1000 issues GUI_UPDATE (start) command 
( step ST5404 ) . The GUIJJPDATE ( start ) command is 
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command for instructing the control unit 1240 of the 
VCR 1200 to send new control panel if the control panel 
is changed, and the control unit 1240 of the VCR 1200 
obeys such instruction until it receives GUIUPDATE 
( stop ) command . 

Then, the control unit 1130 of the television 1000 
issues PUSH_GUI command ( step ST5405 ) to request the 
control panel of the VCR 1200. When such a control 
panel is received, the control unit 1240 of the VCR 
1200 transfers the control panel in the control panel 
generation unit 1220 to the television 1000 via the 
AV/C asynchronous connection protocol layer 540 ( step 
ST5406). The transferred control panel is stored in 
the display data memory 1090 of the television 1000 and 
then is displayed on the display unit 1110. 
Incidentally, in this case, the list of the history 
elements shown in Fig. 18 is also transferred together 
with the control panel . 

By the above operations, the control panel of the 
VCR 1200 shown in Fig. 6 is displayed on the display 
unit 1110 of the television 1000. 

In this condition, when the "finish" key 2100 
shown in Fig. 2 is depressed (step ST505 in Fig. 9), 
screen clear process is effected (step ST540). 

That is to say, in the screen clear process, 
returning to Fig. 10, the control unit 1130 of the 
television 1000 issues the GUI_UPDATE (stop) command 
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(step ST5410). Then, Detach_Release command, 
Disconnect AV command and Disconnect command are issued 
(steps ST5411, ST5412), so that connection to the VCR 
1200 via the AV/C asynchronous connection protocol 
layer 540 is ended and the control panel presently 
displayed is erased. 

Returning to Fig. 9, if either one of the "up" key 
2200 "down" key 2300, "left" key 2400 or "right" key 
2500 is depressed (step ST503 ) , control panel process 
is effected (step ST520). 

In the control panel process, the control unit 
1130 of the television 1000 performs the processing by 
properly controlling the drawing control unit 1100, 
display data memory 1090 and 1394 interface 1080. Upon 
depression of either one of the "up" key 2200, "down" 
key 2300, "left" key 2400 or "right" key 2500, in the 
control panel displayed on the display unit 1110, the 
cursor positioned on the selected button is shifted 
(up, down, left or right) in a direction indicated by 
the key. 

For example, now, it is assumed that the control 
panel shown in Fig. 6 is displayed. In this case, when 
the "left" key 2400 is depressed, the cursor is shifted 
from the stop button 302 onto the temporary stop button 
305. If the cursor cannot be shifted at the end, round 
process is effected. That is to say, for example, in a 
condition that the cursor 307 is positioned on the 
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temporary stop button 305 of the control panel shown in 
Fig. 6, if the "left" key 2400 is depressed, the cursor 
307 is shifted on the record button 306. 

Further, in the control panel process, the 
shifting history of the cursor 307 is stored in the 
memory of the control unit 1130. This is one of 
characteristics of the first embodiment. For example, 
when the cursor 307 is shifted from the fast feed 
button 304 onto the reproduction button 301, first of 
all, the button ID "304" of the fast feed button 304 is 
stored in the memory of the control unit 1130, and, 
thereafter, the cursor is shifted onto the reproduction 
button 301. When the cursor 307 is shifted from the 
rewind button 303 onto the reproduction button 301, the 
button ID "303" of the rewind button 303 is stored in 
the memory of the control unit 1130. 

On the other hand, if the button is released 
rather than depression, the cursor is not shifted. 

Returning to Fig. 9, if the "determination" key 
2600 is depressed or released (step ST504), control 
process is effected (step ST530 ) . 

In this control process, control process effected 
when the cursor 307 is shifted from the stop button 302 
onto the reproduction button 301 and the "determination 
key" 2600 is depressed will firstly be described. In 
this case, the button ID "302" of the stop button 302 
is stored in the memory of the control unit 1130. 
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In the control process, upon depression of the 
"determination" key 2600, the button ID of the button 
element on which the cursor 307 is positioned is read 
out by referring to the display data memory 1090. 
Here, the button ID "301" of the reproduction button 
301 is read out from the display data memory 1090. 
And, a history element having the same button ID of the 
button element as that of the button element on which 
the cursor 307 is presently positioned is sought by 
referring to the "contents 1" in the list of history 
elements shown in Fig. 8. Here, the history elements 
having the history IDs "503", "504" are candidates. 
Since there are candidates here, next, a history 
element having the same contents as the contents 
(button ID "302" of the stop button 302) in the memory 
of the control unit 1130 is sought in the "contents 2" 
of the history elements among these candidates. Here, 
there is no history element having the same contents. 
In this case, the button ID "301" of the button element 
on which the cursor 307 is presently positioned is sent 
to the VCR 1200 together with the action code 
corresponding to the "depression" as user operation 
information . 

When the VCR 1200 receives the user operation 
information, if the received ID is "302" and the action 
code is "depression", it is recognized that there is 
instruction of "reproduction" and the 
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record/reproduction unit 1230 is changed to a 
reproduction condition and the connection regarding the 
isochronous transferring to the television 1000 is 
established and the moving image data from the 
5 record/reproduction unit 1230 is transferred to the 
television 1000 via the isochronous connection. 

Next, control process effected when the cursor 307 
is shifted from the fast feed key 304 onto the 
reproduction key 301 and the "determination" key 2600 

\* 10 is depressed will be described. In this case, the 

M 

fj button ID "304" of the fast feed button 304 is stored 

in the memory of the control unit 1103. 

Ill In this control process, as is in the 

M 

t aforementioned control process, the button ID (button 

» ■ 

f[| 15 ID "301" of the reproduction button 301) of the button 

H> 

fij element on which the cursor 307 is presently positioned 

is read out from the display data memory 1090, and a 
history element having the same button ID is sought by 
referring to the "contents 1" of the list of the 

20 history elements. Here, the history elements having 
the history IDs "503", "504" are candidates. Since 
there are candidates here, next, a history element 
having the same contents as the contents ( button ID 
"304" of the fast feed button 304) in the memory of the 

25 control unit 1130 is sought in the "contents 2" of the 
history elements among these candidates. Here, the 
history element having the history ID "504" is sought 
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as the history element having the same contents. In 
this case, the history ID "504" of the history element 
is sent to the VCR 1200 together with the action code 
corresponding to the "depression" as user operation 
information . 

When the VCR 1200 receives the user operation 
information, if the received ID is "504" and the action 
code is "depression", it is recognized that there is 
instruction of "fast feed reproduction" and the 
record/reproduction unit 1230 is changed to a fast feed 
reproduction condition and the connection regarding the 
isochronous-transferring to the television 1000 is 
established and the moving image data for fast feed 
reproduction from the record/reproduction unit 1230 is 
transferred to the television 1000 via the isochronous 
connection. 

Next, control process effected when the cursor 307 
is shifted from the reproduction key 301 onto the stop 
key 302 and the "determination" key 2600 is depressed 
will be described. In this case, the button ID "301" 
of the reproduction button 301 is stored in the memory 
of the control unit 1103. 

In this control process, upon depression of the 
"determination" key 2600, the button ID (button ID 
"302" of the stop button 301) of the button element on 
which the cursor 307 is presently positioned is read 
out from the display data memory 1090, and a history 
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element having the same button ID is sought by 
referring to the "contents 1" of the list of the 
history elements. Here, there is no same history 
element. In this case, the button ID "302" of the 
button element on which the cursor 307 is presently 
positioned is sent to the VCR 1200 together with the 
action code corresponding to the "depression" as user 
operation information. 

When the VCR 1200 receives the user operation 
information, if the received ID is "302" and the action 
code is "depression", it is recognized that there is 
instruction of "stop" and the record/reproduction unit 
1230 is changed to a stop condition and the 
transferring of the moving image data from the 
record/reproduction unit 1230 to the television 1000 is 
stopped and the connection regarding the isochronous 
transferring to the television 1000 is disconnected. 

As mentioned above, when the operator shifts the 
cursor 307 to manipulate the "determination" key 2 600, 
in consideration of not only the key position after the 
shifting of the cursor 307 but also the key position 
before the shifting of the cursor 307, the VCR 1200 
recognizes the control contents from the television 
1000. In this way, even when the number of keys of the 
remote controller 1140 of the television 1000 is 
relatively few, the operations greater than the number 
of keys can be effected with respect to the VCR 1200 
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and the -transferring data amount between the television 
1000 and the VCR 1200 can be reduced. That is to say, 
even when the operator shifts the cursor 307 onto the 
reproduction button 301 to manipulate the 
"determination" key 2600, different controls can be 
realized ( "reproduction" with respect to the VCR 1200 
when the cursor 307 is shifted from the stop button 302 
onto the reproduction button 301, and "fast feed 
reproduction" with respect to the VCR 1200 when the 
cursor 307 is shifted from the fast feed button 304 
onto the reproduction button 301 ) . 

Incidentally, the process effected when the 
"determination" key 2600 is released is substantially 
the same as the above-mentioned control process, except 
that the action code corresponding to "release" is sent 
to the VCR 1200 as user operation information in place 
of the code corresponding to "depression" . 

For example, when the cursor 307 is shifted from 
the stop button 302 onto the reproduction button 301 
and the "determination" key 2600 is depressed and then 
is released, the button ID' "301" of the button element 
on which the cursor 307 is presently positioned and the 
action code corresponding to "release" are sent to the 
VCR 1200 as the user operation information. 

When the cursor 307 is shifted from the fast feed 
button 304 onto the reproduction button 301 and the 
"determination" key 2600 is depressed and then is 
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released, the history ID "504" of the history element 
and the action code corresponding to "release" are sent 
to the VCR 1200 as the user operation information. 

When the cursor 307 is shifted from the 
reproduction button 301 onto the stop button 302 and 
the "determination" key 2600 is depressed and then is 
released, the button ID "302" of the button element on 
which the cursor 307 is presently positioned and the 
action code corresponding to "release" are sent to the 
VCR 1200 as the user operation information. 

Although the VCR 1200 receives them, the condition 
of the record/reproduction unit 1230 is not changed 
here . 

Next, the operation of the VCR 1200 effected when 
the action code corresponding to "release" is received 
will be described. 

Now, it is assumed that the record/reproduction 
unit 1230 of the VCR 1200 is in the reproduction 
condition. In this condition, when the fast feed 
button 304 is depressed, as mentioned above, the button 
ID "304" of the button element on which the cursor 307 
is presently positioned and the action code 
corresponding to "depression" are sent to the VCR 1200 
as the user operation information. 

When the VCR 1200 receives the user operation 
information, since the received ID is "304" and the 
action code is "depression" and the record/reproduction 
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unit 1230 is now in the reproduction condition, it is 
recognized that there is instruction of "fast feed 
reproduction" and the record/reproduction unit 1230 is 
changed to a fast feed reproduction condition and the 
moving image data for the fast feed reproduction from 
the record/reproduction unit 1230 is transferred to the 
television 1000 via the isochronous connection. 

Then, when the fast feed button 304 is released, 
as mentioned above, the button ID "304" of the button 
element on which the cursor 307 is presently positioned 
and the action code corresponding to "release" are sent 
to the VCR 1200 as the user operation information. 

When the received ID is "304" and the action code 
is "release", the VCR 1200 which received the user 
operation information recognizes the instruction of 
release of "fast feed reproduction", and the 
record/reproduction unit 1230 is changed to the 
reproduction condition, and the moving image data for 
reproduction from the record/reproduction unit 1230 is 
transferred to the television 1000 via the isochronous 
connection. 

As mentioned above, according to the first 
embodiment, when the operator shifts the cursor 307 to 
manipulate the "determination" key 2600, in 
consideration of not only the key position after the 
shifting of the cursor 307 but also the key position 
before the shifting of the cursor 307, the VCR 1200 
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recognizes the control contents from the television 
1000. In this way, even when the number of keys of the 
remote controller 1140 of the television 1000 is 
relatively few, the operations greater than the number 
of keys can be effected with respect to the VCR 1200 
and the transferring data amount between the television 
1000 and the VCR 1200 can be reduced. 
( Second embodiment ) 

Next, a second embodiment of the present invention 
will be explained. Since a construction of the second 
embodiment is fundamentally the same as that of the 
first embodiment, the same constructural elements as 
those of the first embodiment will be omitted in the 
explanation of the second embodiment. 

Fig. 11 is a block diagram showing a construction 
of a remote control system according to the second 
embodiment. In Fig. 11, the same elements as those in 
the first embodiment are designated by the same 
reference numerals and explanation thereof will be 
omitted . 

In the second embodiment, the reference numeral 
1300 denotes a digital photo-album device as a 
controlled device, and a 1394 interface 1210 and a 
control panel generation unit 1220 are the same as 
those in the VCR 1200 of the first embodiment. 

The digital photo-album device includes a digital 
image memory unit 1330 for storing a digital photo 
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image. The digital image memory unit 1330 is like as a 
compact flush card normally used in a digital camera 
but may be the compact flush card itself. Further, the 
digital image memory unit 1330 may be secured to or 
5 detachably attached to the digital photo- album device 
1300. 

A control unit 1240 has fundamentally the same 
construction of the control unit of the VCR 1200 of the 
first embodiment. However, contents of a control panel 
p 10 outputted from the control panel generation unit 1220 

B 

and control for sending the digital photo image in the 

5 51 

J ; 

f~ digital image memory unit 1330 to the external unit 

Pi j 

differ from the first embodiment. 

W 

f Incidentally, similar to the first embodiment, the 

fll 15 television 1000 and the digital photo-album device 1300 

Fll are interconnected via the IEEE 1394 serial bus 1250. 

i-.J; 

y> With the above-mentioned arrangement, only parts 

different from the first embodiment will be explained 
hereinbelow . 

20 Fig. 12 is a view showing a control panel of the 

digital photo-album device 1300 displayed on the 
television 1000. 

In Fig. 12, the control panel includes button 
elements 701 to 716 which use the digital photo image 

25 in the digital image memory unit 1330 as bit map data 
and the digital image memory unit 1330 is thumbnail- 
displayed. The control panel also includes a cursor 
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added by the drawing control unit 1100 of the 
television 1000. 

Now, the button element 706 will be described as 
an example. 

The button element 706 has "706" as button ID, as 
well as the following history group comprising 
previously set plural button IDs: 

button ID 706; 
button ID 707; 
button ID 703; and 
button ID 702. 

Incidentally, for example, history group ID "806" 
is afforded to the history group. 

Further, the plural button IDs (four button IDs in 
this example) can be stored in the memory of the 
control unit 1130 in an FIFO fashion. 

Now, it is assumed that a cursor 720 is positioned 
on a button element 710. Here, an operation of control 
panel process in this case will be explained 
hereinbelow . 

Here, for example, when the "up" key 2200 is 
depressed, button ID "710" of the button element 710 is 
stored in the memory of the control unit 1130, and the 
cursor 720 is shifted onto the button element 706. 
Then, when the "right" key 2500 is depressed, button ID 
"706" of the button element 706 is stored in the memory 
of the control unit 1130, and the cursor 720 is shifted 
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onto the button element 707. Then, when the "up" key 
2200 is depressed, button ID "707" of the button 
element 707 is stored in the memory of the control unit 
1130, and the cursor 720 is shifted onto the button 
element 703. Then, the "left" key 2400 is depressed, 
button ID "703" of the button element 703 is stored in 
the memory of the control unit 1130, and the cursor 720 
is shifted onto the button element 702. At this point, 
four button IDs are stored in the memory of the control 
unit 1130. Then, when the "down" key 2300 is 
depressed, although button ID "702" of the button 
element 702 is stored in the memory of the control unit 
1130, since the four button IDs were already stored in 
the memory of the control unit 1130, the oldest button 
ID "710" is erased, and the button ID "702" of the 
button element 702 is newly stored. Then, the cursor 
720 is shifted onto the button element 706. In this 
case, the stored contents of the memory of the control 
unit 1130 become "706, 707, 703, 702". 

Here, when the "determination" key 2600 is 
depressed, control process is effected. 

In the control process according to the second 
embodiment, the history group of the button element 
(button element 706 in this case) on which the cursor 
720 is presently positioned is compared with the 
contents stored in the memory of the control unit 1130. 

Here, the result of comparison shows coincidence. 
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In this case, ID (i.e., "806") of the history group of 
the button element (button element 706 in this case) on 
which the cursor 720 is presently positioned is sent to 
the digital photo-album device 1300 together with the 
5 action code corresponding to "depression" as user 
operation information. 

If the received ID is "806" and the action code is 
"depression", the digital photo-album device 1300 which 
received the user operation information recognizes 
iU 10 instruction for left-turning the image of the button 

r -.j 

element having the button ID "706", and left turn 

f m 

f'j" process for the bit map data of the button element 

y] 

having the button ID "706" is effected, and the bit map 
* data of the button element after the left turn process 

jj;:'a 

I'll 15 is transferred to the television 1000 via the 

M 

FU connection in the AV/C asynchronous connection protocol 

0 

t : ;. layer 540. By such transferring, the television 1000 

to which the fact that the control panel is changed is 
noticed renews or updates the display of the control 
20 panel. A renewed control panel of the digital photo- 
album device 1300 is shown in Fig. 13. 

Incidentally, the result of comparison between the 
history group of the button element on which the cursor 
720 is presently positioned and the contents stored in 
25 the memory of the control unit 1130 does not show 

coincidence, the button ID (button ID "706" in the 
above case ) of the button element on which the cursor 
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720 is presently positioned is sent to the digital 
photo-album device 1300 together with the action code 
corresponding to "depression" as user operation 
information . 

If the received ID is "706" and the action code is 
"depression", the digital photo-album device 1300 which 
received the user operation information recognizes 
instruction for displaying the image of the button 
element having the button ID "706" in a larger scale 
(same as conventional thumbnail display), and process 
according to such instruction is effected. 

Incidentally, in the control process according to 
the second embodiment, after the user operation 
information was sent, the memory of the control unit 
1300 is cleared. 

In the control process mentioned above, it should 
be noted that the shifting trace of the cursor 720 
becomes like a left turn circle including the button 
element 706. 

Incidentally, here, the history group of the 
button element 706 may including the following IDs: 

button ID 706; 

button ID 710; 

button ID 711; and 

button ID 707. 
In this case, by shifting the cursor 720 onto the 
button element 706, button element 710, button element 
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711, button element 707 and button element 706 in order 
and by depressing the "determination" key 2600, the 
similar process to the above-mentioned instruction for 
left-turning and displaying the image of the button 
element 706 can be realized. 

Further, the button element 706 may have the 
following two history groups: 

button ID 706; 

button ID 707; 

button ID 703; 

button ID 702; 

and 

button ID 706; 

button ID 710; 

button ID 711; 

button ID 707. 
In this case, even when the cursor 720 is shifted onto 
the button element 706, button element 707, button 
element 703, button element 702 and button element 706 
in order or even when the cursor 720 is shifted onto 
the button element 706, button element 710, button 
element 711, button element 707 and button element 706 
in order, by depressing the "determination" key 2600 
immediately after, the similar process to the above- 
mentioned instruction for left-turning and displaying 
the image of the button element 706 can be realized. 

Furthermore, as mentioned above, since the memory 
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of the control unit 1130 is cleared after the user 
operation information was sent, even in a case where 
the shifting history of the cursor 720 includes, for 
example, the fact that the cursor was shifted onto the 
5 button element 706, button element 707, button element 
703, button element 702 and button element 706 in 
order, when the "determination" key 2600 is depressed 
in the condition that the cursor 720 is positioned on 
the button element 702, if the cursor 720 is then 
10 shifted onto the button element 706 and the 

"determination" key 2600 is depressed, since the 
history group of the button element on which the cursor 
720 is presently positioned differs from the contents 
stored in the memory of the control unit 1130, the 
fU 15 above-mentioned process for left-turning and displaying 

the image of the button element 706 is not effected. 

Furthermore, the history group of the button 
element 706 may include the following IDs: 

button ID 706; 
20 button ID 702; 

button ID 703; and 
button ID 707. 
In this case, when the cursor 720 is shifted onto the 
button element 706, button element 702, button element 
25 703, button element 707 and button element 706 in order 
and the "determination" key 2600 is depressed, 
instruction for left-turning and displaying the image 
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of the button element 706 can be realized. 

As mentioned above, according to the second 
embodiment, by shifting the cursor along the left turn 
circle starting from the target image, the instruction 
for left-turning the target image can be achieved, and, 
by shifting the cursor along a right turn circle 
starting from the target image, the instruction for 
right-turning the target image can be achieved. That 
is to say, an operational environment in which the 
operator can easily effect manipulation intuitively can 
be provided. 

Incidentally, in the remote control system 
according to the above-mentioned embodiments, while an 
example that the control device is constituted by the 
television and the controlled device is constituted by 
the video cassette recorder or the digital photo-album 
device 1300 was explained, the present invention can be 
applied as a method in which the number of operations 
is increased without increasing the number of keys of 
the remote controller 1140 in the television. 

Incidentally, it should be noted that the present 
invention can be achieved by supplying a storing medium 
storing a program code of software for executing the 
functions of the above-mentioned embodiments to the 
system or the apparatus and by reading out and 
executing the program code stored in the storing medium 
by means of a computer (or CPU or MPU) of the system or 
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-the apparatus. 

In this case, the program code itself read out 
from the storing medium realizes new functions of the 
above-mentioned embodiments, and, thus, the storing 
medium storing such program code constitutes the 
present invention. 

As the storing medium for supplying the program 
code, for example, a floppy disk, a hard disk, an 
optical disk, a photo-magnetic disk, CD-ROM, CD-R, a 
magnetic tape, a non-volatile memory card or ROM can be 
used . 

Further, it should be noted that the present 
invention includes a concept that not only the 
functions of the above-mentioned embodiments are 
realized by executing the program code read out by 
means of the computer, but also OS (operating system) 
running on the computer executes the actual processing 
partially or totally on the basis of instruction of the 
program code to realize the functions of the 
embodiments . 

Further, it should be noted that the present 
invention includes a concept that, after the program 
code read out from the storing medium is written in a 
memory of a function expansion board inserted into the 
computer or a function expansion unit connected to the 
computer, a CPU of the function expansion board or of 
the function expansion unit executes the actual 
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processing partially or totally on the basis of 
instruction of the program code to realize the 
functions of the embodiments. 

Further, in the above-mentioned preferred 
embodiments of the present invention, while an example 
that the communication circuit for interconnecting the 
control device and the controlled device is constituted 
by the IEEE 1394 serial bus 1250 was explained, the 
present invention is not limited to such a 
communication circuit. 

The invention may be embodied in other specific 
forms without departing from essential characteristics 
thereof . 

Therefore, the above-described embodiments are 
merely exemplary of this invention, and are not be 
construed to limit the scope of the present invention. 

The scope of the present invention is defined by 
the scope of the appended claims, and is not limited to 
only the specific descriptions in this specification. 
Furthermore, all the modifications and changes 
belonging to equivalents of the claims are considered 
to fall within the scope of the present invention. 



